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INFORMATION PROCESSING DEVICE , PICTURE PRODUCING METHOD , 

AND PROGRAM STORING MEDIUM 



R&r.KfiROUN n of THE INVENTION 
TTTFT.n OF T ^Fi TNVENTION 

The present invention relates to an information processing 
device, a picture producing method, and a program recording medium, 
and more particularly, is suitably applied, for example, to an 
information processing device in which a spectrum analyzer picture 
and a background picture are composed and displayed. 

p F ,gr.RTPTI QM <">F THE RELATED ART 

Previously, in an application program of a personal computer, 
there is a slide-show program in which a plurality of previously 
registered pictures are switched and displayed for each specified 
time interval. Furthermore, there are slide-show programs in which 
the sound output is simultaneously used, such as a program in 
which a music is outputted as BGM when displaying a picture or a 
program in which a sound effect is produced or the like at the 
time of switching a picture. 

However, in such slide-show programs, the picture data and 
sound data are independently treated, and there has been a problem 
of not performing any bilateral display such as a display where 



- 1 - 



the change of the sound data affects the display of the picture 
data . 

ftTlMMARY THB TNVENTION 

In view of the foregoing, an object of this invention is to 
provide an information processing device, an picture producing 
method, and a program storing medium in which the picture is 
related to the sound to be displayed. 

The foregoing object and other objects of the invention have 
been achieved by the provision of an information processing device 
which comprises sound signal obtaining means for obtaining a sound 
signal, sound signal analyzing means for frequency-analyzing the 
obtained sound signal, frequency-analyzed picture producing means 
that produces a specified frequency-analyzed picture on the basis 
of a result of the frequency analysis, selected picture switching 
means that switches and selects one among a plurality of 
registered pictures as a selected picture on the basis of a level 
of the obtained sound signal, and composed picture display means 
that displays a composed picture produced by composing a 
frequency-analyzed picture and a selected picture. 

On the basis of a level of the sound signal, the selected 
picture is switched and it is composed with a frequency-analyzed 
picture, so that a composed picture changing according to the 
change of the sound signal can be produced. 
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Furthermore, in the present invention, a picture element of a 
frequency-analyzed picture and a corresponding picture element of 
a selected picture are logically operated to produce a composed 
picture, so that a composed picture changing without being late 
for the level change of the sound signal can be produced. 

Furthermore, in the present invention, a composing method of a 
frequency-analyzed picture and the above described selected 
picture is changed on the basis of the level of the sound signal, 
so that a composed picture changing according to the change of the 
sound signal can be produced. 

The nature, principle and utility of the invention will become 
more apparent from the following detailed description when read in 
conjunction with the accompanying drawings in which like parts are 
designated by like reference numerals or characters. 

ppT f.F nES^PTPTTON OF THF, PKAWINGS 
In the accompanying drawings: 

Fig. 1 is an illustration showing the total configuration of a 
notebook-sized personal computer according to the present 

invention; 

Fig. 2 is a side view showing the configuration of a left side 
of a main body; 

Fig. 3 is an illustration showing the configuration of a rear 
side and an under surface of the main body; 
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Fig. 4 is an illustration showing the external appearance of a 

jog dial attached to the main body; 

Fig. 5 is a block diagram showing the circuit configuration of 

the notebook-sized personal computer; 

Fig. 6 is a flow chart showing a processing procedure of a 

spectrum analyzer program; 

Fig. 7 is an illustration showing a spectrum analyzer picture; 

Fig. 8 is an illustration showing a composing method of 
pictures ; 

Fig. 9 is an illustration showing a selected picture; 

Fig. 10 is an illustration showing a composed picture; and 

Fig. 11 is an illustration showing a composed picture. 

rFlT ^TT.F.r. D^^TPTTnN OF THE F.MBOPIMENT 

Preferred embodiments of this invention will be described with 
reference to the accompanying drawings: 
(1) configuration of Notebook-Sized Personal Computer 

in Fig. 1, reference numeral 1 denotes a notebook-sized 
personal computer (hereafter, this is called a note-PC) that 
configures an information processing device of the present 
invention as a whole, and it is configured by a main body 2 and a 
display section 3 attached to the above described main body 2 in a 
way in which opening and closing can freely be performed. 

The main body 2 has, on the upper surface thereof, a plurality 
of operating keys 4 for inputting various characters, marks, and 
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numerals or the Ilk., a stick type pointing device 5 (hereafter, 
this is simply called a stick) that is used for the movement of a 
mouse cursor, a left click button 5A and a right click button SB 
corresponding to a left button and a right button in a normal 
..ouse, a center button 5C for operating a scroll button without 
fitting the mouse cursor to the scroll button, a built-in speaker 
6, and a shutter button 7 for a Charge Coupled Device (OCD> camera 
23 provided to the display section 3. 

To the display section 3, at the front, a liquid crystal 
display 21 of a Liquid Crystal Display (LCD) is provided, and at 
the central upper end section in front, an image-pickup section 22 
with a CCD camera 23 is rotatably attached to the display section 

That is, the image-pickup section 22 is arranged so that it 
^ay rotate within an angular range of 180 degrees between the 
front direction and the rear direction of the display section 3, 
and that it may be positioned at any position within the above 
described angular range. Furthermore, to the image-pickup sect.cn 
22, an adjusting ring 25 for performing the focus adjustment of 
the CCD camera 23 is provided, and it is arranged that the focus 
adjustment at the time when a desired image-pickup object is 
image-Picked up by the above described CCD camera 23 can easily be 
performed by the rotational operation of the adjusting ring 25. 

Furthermore, to the display section 3, a microphone 24 is 
provided near the neighborhood on the left side of the image- 
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pid cup section 22, and it is arrant that the sound can also be 
gathered fro. the rear side of the display section 3 through the 
above described microphone 24. 

Moreover, to the display section 3, a claw 13 is provided near 

_ ^ ^ left side of the microphone 24, and in the 
the neighborhood on the left siae o 

■m-a ,f a soecified position of the main 
meantime, a hole 8 is provided at a speciri 

the above described claw 13, and it is 
body 2 corresponding to tne aoove « 

arranged that the daw 13 is fitted in the hole 8 to be looted in 
t he state where the display section 3 is closed onto the ™ain body 

To the main body 2, a slide lever 9 is provided on the front 
side, and it is arranged that the loc* of the claw 13 fitted in 
the hole 8 is released by sliding the above described slide lever 

■a ^r, Ho ooened from the main body 
9 and that the display section 3 can be opened 

„ FT . ont side 0 f the main body 2, a plurality 
2. Furthermore, on the front side or 

of ventilating holes 11 are provided. 

Furthermore, on the right side of the main body 2, a 
ventilating hole 12 , a PC card slot 14 corresponding to a Personal 
Computer (PC) card of Personal Computer Memory Card Xnternational 
relation (PCMCIA) standard, and a modem terminal 15 for a 
modular jack are provided. 

^ain body 2, a slide type power source switch 40, an Xnstitute of 
Electrical and Electronics Engineers (IEEE) 1394 terminal 41 
^responding to four pins, a Universal Serial Bus W SB, terminal 
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42, an external display connector 06, a microphone input terminal 

43, a headphone terminal 44, and an infrared port 45 based on 
infrared Data Association (IrDA) are provided. 

Furthermore, as shown in Fig. 3, on the rear side of the main 
b „dy 2, an external power source connector 16 is provided, and at 
the bottom surface, a slide type removing lever 18 for removing a 
battery pack <not shown in the figure, and a reset switch 19 for 
interrupting the operation and reconfiguring the environment at 
the time of feeding of the power source are provided. Herein, the 
battery pack is connected to a battery connector 17 in a way in 
which installation and removal are freely performed. 

in addition to such a configuration, to the upper surface (Fig. 
1, of the main body 2, in the right end section, between an 
operating key 4A corresponding to a back space key and an 
operating key 4B corresponding to an enter key, a Jog dial 30 is 
assembled so that it may have the same height as the above 
described operating keys 4A, 4B. 

Here, the jog dial 30 is a user interface excellent in 
operability, by which the system setting or various functions in 
various types of application software can easily be realized by 
the rotational operation or the pressing operation of the dial. 

This jog dial 30 is attached, as shown in Fig. 4, in the state 
where a disc-like operating knob 218 with a parallel pattern is a 
little projecting from an armoring case 32 of the main body 2, and 
it is arranged that a specified processing is executed according 
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fho direction shown by arrow a or the 
to a rotational operation in the directio 

. bv arrow b with the disc-like operating knob 218, 
direction shown by arrow d w 

. „ ■ _ OY acuted according to a 
and that a specified processing is execute 

in the direction shown by arrow c. 
pressing operation in tne a 

n* since the jog dial 30 is mounted so that the 
At this moment, since >»« -> 

• v oh 218 ™ay be a little projected from the 
dl sc-li*e ope—, -ob 21. -* ^ 

ar^orina case 32 of the «» bo*r 2. . use ^ 

„h«al side surface 218A of the projectxng disc 
peripheral sicus 32 (Fig. 

creep on the armoring case 3Z i*xg 
knob 218 while making a finger creep 

tnob 218, the thickness 
a> Herein, in the disc-like operating knob 

hereof can be decreased as lon 9 as the stiffness is insured, and 

ntly it is Possible to sufficiently comply with thin— 
consequently, xt xs 

of the main body 2. _ . u. 

Next , the circuit conflation of the note-PC w i be 

■ „ n«it (CPU) 50 that generally 
note-PC 1, a Central Processing Unit (CPU) 

,. , in the above described main body 2 is 
controls various functions in the abo 

^ ^ is arranged that various 
^t-ori to a host bus 52, and it is arrang 
ZZ 1 - reaped by — « the processing according to 
lious program and application software loaded in a ^ndo. 

IDSM1 53 bv the above described CPU 50 at a 
Access Memory (RAM) 53 by the a 

basis of a system clock given 
specified operating speed on the basis 

from a clock generator 60. 
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Further**,™, to the host bus 52, a cache memory 51 is 
connected, and it is arranged that the data to be used by the CPU 
50 is cached and a high speed access can be realized. 

This host bus 52 is connected to a Peripheral Component 
Interconnect .PCX, bus 55 through a host-PCX bridge 54, and to the 
ebove described PCX bus 55, a video controller 56, an xnstitute or 
metrical and Electronics Engineers (IEEE) 1394 interface 57, a 
video capture processing chip 83, and a Personal Computer (PC, 
card interface 58 are connected. 

Here, the host-PCX bridge 54 is arranged so that it nay 
control the giving and receiving of the various data, which are 

4-v, pnri =o and the video controller 56, video 
performed between the CPU 50 and tne vilo. 

capture processing chip 83, IEEE 13*4 interface 57, and PC card 
interface 58, and that it may perform the memory control of the 
RAM 53 connected through a memory bus 59. 

Furthermore, the host-PCX bridge 54 is connected to the video 
controller 56 through a signal wire along an Accelerated Craphics 
Port (AGP, , and consequently, it is arranged that the picture data 
can be transmitted at a high speed between the host-PCX bridge 54 
and the video controller 56. ^ 

The video capture processing chip 83 is connected to an I c 
bus 82 (generally, also called a System management <SM, bus, of a 
serial bus, and it is arranged that when the picture data that » 
image-piCed up by the Charge Coupled Device (CCD, camera 23 is 
supplied through the above described I-C bus 82, this is once 
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stored in a built-in frame memory (not shown in the figure) , and 
by performing the picture compression processing according to 
joint Photographic Experts Group (JPEG) standard, the JPEG picture 
data is produced, and after that, the above described JPEG picture 
data is again stored in a frame memory. 

Then, the video capture processing chip 83 directly transmits 
the JPEG picture data stored in the frame memory to the RAM 53 by 
using the bus master function according to the request from the 
CPU 50, and after that, it transmits the data to a hard disc drive 
(HDD) 67 as the JPEG picture (static picture) data or the Motion 
JPEG picture (dynamic picture) data. 

The video controller 56 is arranged so that it may apply the 
specified graphics processing to the picture data that is image- 
picked up by the Charge Coupled Device (CCD) camera 23 or the JPEG 
picture data of the video capture processing chip 83, and after 
that, it may store the data in a built-in Video Random Access 
Memory (VRAM) to read out the data on occasion, and it may output 
the data to the liquid crystal display 21 to display that. 

Furthermore, the video controller 56 is arranged so that a 
plurality of window screens can be displayed by outputting the 
picture data based on various kinds of timely supplied application 
software to the liquid crystal display 21. 

The PC card interface 58 is arranged so that it may properly 
be mounted through a PC card when adding an optional function, and 
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it is arranged so that it can be connected to an external device 
such as a CD-ROM drive or a DVD drive through a PC card. 

The IEEE 1394 interface 57 is directly connected to the IEEE 
1394 terminal 41, and it is arranged so that it may be connected 
to an external device such as another computer device or a digital 
video camera through the above described IEEE 1394 terminal 41. 

The PCI bus 55 is connected to an Industrial Standard 
Architecture (ISA) bus 65 through a PCI-ISA bridge 66, and to the 
above described PCI-ISA bridge 66, an HDD 67 and a Universal 
Serial Bus (USB) terminal 42 are connected. 

Here, the PCI-ISA bridge 66 is configured by an Integrated 
Drive Electronics (IDE) interface, a configuration register, a 
Real-Time Clock (RTC) circuit, and a USB interface or the like, 
and it performs the control of the HDD 67 through the IDE 
interface on the basis of the system clock given from the clock 
generator 60 . 

in a hard disc of the HDD 67, an Operating System (OS) such as 
Windows 98 (trademark) , an electronic mail program, an auto-pilot 
program, a jog dial utility program, a jog dial driver, capture 
software, and digital map software, and further, various kinds of 
application software other than these are stored, and they are 
transmitted to the RAM 53 on occasion in the process of the 

starting processing. 

Furthermore, the PCX-ISA bridge 66 controls external devices 
such as a floppy disc drive, a printer, and a USB mouse that are 
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connected through a USB terminal <2 and are not shown in the 
fig ure, through the USB interface, and in the meantime, xt 

^ *Q *nd a sound controller 70 that are connected 
controls a modem 69 and a souna 

to an ISA bus 65 . 

The node* «• is connected to an inte.net service provider 
.hereafter, this is called a provide,, through a public telephone^ 
Une and an internet that are not shown in the figure fro. a mode, 
terminal 15. so t h at it may access the above desert prov.de. 

n . sound controller 70 converts a sound signal tafcen ,n 
tne aerophone 24 into digital to produce the sound data, 
outputs this to the CPU SO and in the meantime, it converts the 
sound data supplied fM the CPU SO into analog to produce the 
sound signal, and it outputs this to the outside through the 

built-in speaker 6. 

furthermore , to the XSX .us 6S, an m/Out .X/O, controlier 
is connected, and it receives the supply of the power fro* an . 
externa! power source connector S4 through a power source supply 
charging control circuit es, and it performs the supply of the 

furthermore, here, the !,o controller 73 also operates on the 
^sis of the system cloc* supplied fro. the cloc-c generator 60. 

furthermore, the power source supply charging control c.rcu.t 
85 iS controlled by the I/O controller 73, and it controls the 

charging of the battery pac* 36 connected to the battery connector 

17 (Fig. 3) . 
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This I/O control^ 73 is configured by a micro controller, an 
X/O interface, a CPU, a ROM, and a «. or the li.ce, and it 
controls the input and output of the data between the OS or 
appl ication software and the various peripheral apparatus such as 
the liquid crystal display 21 or HDD 67 on the basis of Basic 
Input/Output system (BIOS) stored in a flash memory 79. 

Furthermore, the I/O controller 73 is connected to the 
infrared port .5 , and it is arranged so that the infrared 
communication may be performed, for example, with another computer 
device. Moreover, the I/O controller 73 is connected to a 
reversing switch 77, and when the image-piCcup section 22 of the 
CCD camera 23 is rotated by ISO degrees in the direction of the 
rear side of the liquid crystal display 21, the reversing switch 

j ,. he cpu so is notified of that effect through 
77 is turned on, and the CPU =>" 

the PCI-ISA bridge 66 and the host-PCI bridge 54. 

Moreover, the I/O controller 73 is connected to a full- 
pressing and half -pressing switch 78, and when the shutter button 
7 provided on the upper surface of the main body 2 is made in the 
naif-pressed state, the fuil-pressing and half-pressing switch 78 
i. turned on, and the CPU 50 is notified of that effect, and in 
the meantime, when the shutter button 7 is made in the fully- 
pressed state, the full-pressin, and half-pressing switch 78 is 
turned on, and the CPU 50 is notified of that effect. 

That is, in the state where the capture software is raised on 
the RAM 53 from the hard disc of the HDD 67, when the shutter 
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. ' in the half -pressea state by the user, the CPU 50 
button 7 is made in the nan p 

' the static picture ana it controis the CC D camera 23 

8 t Z J- of the static picture, anc when the shutter 

to execute the ^ „ ^ in the 

button 7 is made in the ruxxy p 

controller 56. it mav enter 

CPU 50 is arranged so that it may e 
On the contrary, the CPU 

to take in the dynamic picture up to a 
the dynamic picture mode to take 

video controller 5. .hen the shutter button 7 is made in - 

4-v,« =*-ate where the capture 
* =i-ate bv the user in the state 
fully-P r6Ssed state oy 

software is not raised. a wa ke -up program, 

in the ROM of the I/O controller 73, a wake up P 
Herein, in tne « 

nroflram a n LED control program, and a D og 
a kev mput monitoring program, 

an d other various control programs 
dial state monitoring program, and other 

are stored. program 
Here the jog dial state monitoring program is pr 

rela ;;;: j» - — — - - ~ r of 

the HDD 67, and it is a program for monitoring whether 3 og 

ted by the rotational operation or pressing 
dial 30 is operated by tne ro 

operation or not. controlled by the CPU 

The wake-up program is a program that is 

a specified processing when the present 
50 so that it may execute a specif ie p 

• +. in the PCI-ISA bridge 6t> 
time supplied from the RTC circuit m the 

■ « et starting time, and the key input 

becomes the previously set starting 
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storing Program is a program for monitoring the input from the 

operating key 4 and other key switches. 

The LED control program is a program for controlling the 
lighting of various lamps made of the light Emitting Diode (LED) 
such as a power source lamp PL, a battery lamp BL, or a message 
lamp ML. 

Furthermore, in the RAM of the I/O controller 73, a set time 
register for the walce-up program, a key input monitoring register 
for the key input monitoring program, an UD control register for 
the LED control program, and an I/O register for the jog dial 

^ roisters for other various programs 
state monitoring program, and registers 

are provided. 

The set time register is arranged so that it may store the 
time information of the starting time that is previously and 
arbitrarily set by the user for being used in the wake-up program, 
^cordingly, the I/O controller 73 Judges whether the present t,me 
supplied from the RTC circuit has become the arbitrarily set 
starting time or not on the basis of the wake-u P program, and when 
the time has become the starting time, it notifies the CPU 50 of 
that effect. Consequently, the CPU 50 raises a previously set 
specified application software when the time has become the 
starting time, and executes a specified processing according to 
the above described application software. 

The key input monitoring register is arranged so that it may 
store an operating key flag on the basis of the input of the 
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operatic key «. stick 5, left click button 5A, right elide button 

5B, and center button 5C . 

Accordingly, based on the key input monitoring program, the 
I/O controller 73 judges, for example, whether the pointing 
operation by the stick 5 or the clicking operation of the left 
click button 5A, right click button 5B, and center button SC is 
performed or not on the basis of the state of the operating key 
flag, and when the pointing operation or clicking operation is 
performed, it notifies the CPU 50 of that effect. 

Here, the pointing operation means an operation of moving the 
m ouse cursor to a desired position by pressing and operating the 
stick 5 upward or downward and leftward or rightward by a finger, 
and the clicking operation means an operation of ouickly pressing 
and releasing the left click button 5A or right click button 5B by 
a finger. 

Consequently, the CPU 50 executes a specified processing 
according to the movement of the mouse cursor by the pointing 
operation or the clicking operation. 

The LED control register is arranged so that it may store the 
lighting flag indicating the lighting state of various lamps made 
of the LED such as the power source lamp PL, battery lamp BL, or 

message lamp ML. 

Accordingly, the I/O controller 73 stores the lighting flag, 
when the CPU 50 reads an electronic mail program out of the hard 
disc of the HDD 67 and raises that on the RAM 53 and receives an 
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electronic .11 according to the above described electronic mail 
program, for example, by the pressing operation of the Jog dial 30, 
and in the meantime, it lights the message lamp ML by controlling 
the LED 81 on the basis of the above described lighting flag. 

The I/O register for the jog dial state monitoring program is 
arranged so that it may store a rotational operation flag and a 
pressing operation flag according to the rotational operation and 
pressing operation performed to the Jog dial 30, respectively. 

Accordingly, the I/O controller 73 stores the rotational 
operation flag and pressing operation flag in the I/O register 
when a menu item desired by the user is selected from among a 
plurality of menu items by the rotational operation and pressing 
operation of the Jog dial 30 connected through a rotation 
detecting section 88, and in the meantime, it notifies the CPU 50 
of that effect. 

Consequently, according to the Jog dial utility program that 
has been read out of the HDD 67 and started on the RAM 53 , the CPU 
50 raises the application software corresponding to the menu item 
determined by the rotational operation and pressing operation of 
the Jog dial 30, and it executes a specified processing. 

Here, the I/O controller 73 is operating at all times on the 
basis of the jog dial state monitoring program by the control of 
the power source supply charging control circuit 85, even in the 
state where the power source switch 40 is turned off and the OS is 
not started, and it is arranged so that it may start the 
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i Fii. desired by the user, by the 
application software or scra.pt file desirea y 

pressing operation of the jog dial 30 even in the state of power- 

providing a special key. 

Herein, the I/O controller 73 is connected to an X C bus 82, 
a„d it is arrant so that it may control the on/off of the camera 

„r- that it may adjust the degree 
power source in the CCD camera 23 or that it y 

„ traJt in the CCD camera 23, by supplying 
of brightness or contrast in tne 

.. C-.CD camera 23 set by the operating 

various set parameters to the CCD camera 

key 4 or jog dial 30, through the I ! C bus 92. 

12) Spectrum Analyzer Program 

t- *■ w 1 the CPU 50 reads the previously 
Furthermore, in the note-PC 1, the cfu 

Mistered music data out of the HDD 67 and reproduces that from 
the speaker 24, on the basis of the spectrum analyzer program 
.hereafter, this is called the SP E -»* P-gram, stored in the HDD 
67 and in the meantime, it f reguency-analyzes the sound of the 
above described music data for each specified band, and on the 
^sis of the result of the above described analysis, it produces a 
spectrum analyzer picture .hereafter, this is called a SPS-AH* 
picture, Pspc indicating the signal level for each band. 

Then, the CPU 50 reads a plurality of previously registered 
static Picture data .hereafter, this is called a registered 
picture Preg> out of the HDD 67, and selects one a^ng the above 
aescribed plurality of read-out registered pictures Preg as the 
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selected picture Psel, and further, it composes the above 
described selected picture Psel and SPE-ANA picture Pspc to 
produce a composed picture Pcomp, and it displays the picture on 
the liquid crystal display 21. At this moment, the CPU 50 changes 
the selected picture Psel on the basis of the result of the 
analysis of the music data, and in the meantime, it changes the 
composing method of the selected picture Psel and SPE-AHA picture 
Pspc. 

That is, the CPU 50 starts the spectrum analyzer processing 
procedure shown in Fig. 6 according to the starting operation of 

the SPE-ANA program by the user. 

The CPU 50 starts the processing at RT1 , and at STEP SP1 , the 
CPU 50 performs the initialization processing, and reads out a 
plurality of registered pictures Preg stored in the HDD 67 to the 
RAM 53, and it selects one among the above described plurality of 
read-out registered pictures Preg, and in the meantime, it selects 
one among four types of picture composing methods to be described 
later. Then, the CPU 50 reads the music data out of the HDD 67, 
and starts the reproduction. 

At step SP2, the CPU 50 as the sound signal obtaining means 
takes in the sound of the music data during the reproduction 
(hereafter, this is called capture,, and it moves to the next step 



SP3 
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At step SP3 , the CPU 50 as the sound signal analyzing means 
frequency-analyzes the captured sound by using Fast Fourier 
Transform (FFT) , and it moves to the next step SP4 . 

At step SP4 , the CPU 50 as the frequency-analyzed picture 
producing means produces a SPE-ANA picture on the basis of the 
result of the frequency analysis. That is, Fig. 7 shows a SPE-ANA 
picture Pspc, and six indicators fl to f6 are displayed. 

Each of the indicators fl to f6 is configured by fourteen 
display blocks Blk, and nine display blocks Blk from the bottom 
are displayed in green, and in the meantime, five display blocks 
Blk from the top are displayed in red. Furthermore, the background 
of the indicators fl to f6 is displayed in black. 

Each of the indicators fl to f6 indicates a signal level of 
the corresponding frequency band, and the height of each indicator 
fluctuates according to the sound during the reproduction. That is, 
the indicator fl indicates the signal intensity of a band 
(frequency band No. 1) of 0 to 500Hz, and the indicator f2 
indicates the signal intensity of a band (frequency band No. 2) of 
500Hz to 1kHz, and the indicator f3 indicates the signal intensity 
of a band (frequency band No. 3) of 1 to 2kHz. Furthermore, the 
indicator f4 indicates the signal intensity of a band (frequency 
band No. 4) of 2 to 4kHz, and the indicator f5 indicates the 
signal intensity of a band (frequency band No. 5) of 4 to 8kHz, 
and the indicator f6 indicates the signal intensity of a band 
(frequency band No. 6) of 8 to 16kHz. 
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A t step SP5, the CPU 50 as t h e selected picture switching 

i. a specif threshold value or ^ or not. 

native result is obtained at step SP5, this expresses that 

KTft 1 is less than the 
signal level of the frequency band No. 1 is 

specified threshold value, and the CPU 50 to step 7 

0n the contrary, in the case where an af f ir^tive result is 
stained at step SP5 , this expresses that the signal level of the 
f requency band No. > is the specified threshold value or .ore, and 
the CPU 50 advances to step SPS. ~ step SPS, the CPU 50 elects 
cue a^ong a plurality of registered pictures Pre, at rando. 
this be the selected picture Psel, and it ™ves to step " 

Here, the frequency band No. 1 corresponds to the area of the 

the low-pitched sound of a dru», a bass or the li*e in the .us.c 
data during the reproduction, as a trigger. 

A t step SP7 , the CPU 50 Judges whether the signal level of the 

f requency band No. 5 is a specified threshold value or .ore or not. 

In the case where a negative result is obtained at step SP7 th.s 

expresses that the signal level of the frequency band No. x. 

le ss than the specified threshold value, and the CPU 50 »oves to 

step SP9 . _ . 

on the contrary, in the case where an affi-tive result is 

Obtained at step SP7, this expresses that the signal level of 
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v. j u n 5 is the specified threshold value or more, and 
frequency band No. 5 is tne 

the CPU SO advance, to step SPS. A* step SPS, the CPU 50 selects 
one among four types of picture cousin, methods at random 

Here, the frequency band Ho. 5 corresponds to the area of the 
medium-and-high-pitched sound of the vocal or the 11- in the 
mU si=. Therefore, the CPU 50 switches the picture composing method 
» using the vocal or the li*e in the music data during the 
reproduction as a trigger. 

That is, Fig. BA shows the composition of pictures using OR 
U ogi=al sun.) , and a composed picture Pcomp is produced by 
performing the logical sum for each corresponding bit, „ each 
corresponding picture element of the selected picture Psel and^ 

tklt „ e „ ch expressed in color of 24 bits 
SPE-ANA picture Pspc that are eacn e p 

k „F R G B) For example, in the case where 
(eight bits for each of R, G, B) 

t he selected picture Pse shown in Pig. . and the SPE-AHA picture 
Pspc ,Pig. 7, are composed by using the logical sum, a closed 
picture Pcomp shown in Pig. 10 A is produced. In the case of th» 
composed picture Pcomp, in the part corresponding to the 
^ground section of the SPE-AHA picture PsPC the pattern of 
selected picture Psel is displayed as it is, and in the part 
corresponding to the green indicator of the SPE-AHA picture Pspc, 

of the selected picture Psel is emphasized, 
the green component of the select * 

and in the part corresponding to the red indicator of the SPE-AHA 
picture pspc a pattern in which th. red component of the selected 
picture Psel is emphasized is made. 
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Fig 8B shows the composition of pictures using XOR 
( e*clusive-OR> , ana . composed picture Pcomp is produced by 
performing the e*dusive-OR for each corresponding Mt. in each 
^responding picture element of the seiected picture Psel and 
SPE .AKA picture Pspc. That is, Fig. 1« snows a composed picture 
Pcomp b V XOR, and in the part corresponding to the Aground 
section of the SPE-AHA Picture Pspc, the pattern of the seiected 

* »■„ -n- is and in the part corresponding 
picture Psel is displayed as xt is, ana 

to the green indicator of the SPE-ANA picture Pspc, the green 

exponent of the seiected picture Psei is .it-inverted, and in the 

ndina to the red indicator of the SPE-ANA picture 
part corresponding to tne 

4- * elected picture Psel is bxt- 

Pspc, the red component of the selected p 

inverted. 

Fi , 8C shows the composition of pictures using logical 
multiplication (AND) , and a composed picture Pcom* is produced >y 
performing the logical multiplication for each corresponding ta t 
in each corresponding picture element of the selected picture Psel 

o „ T>. a t is Fig. IOC shows a composed 
and the SPE-ANA picture Pspc. That is, ng 

picture Pcomp by «D. and the part corresponding to the Aground 
section of the SPE^ picture Pspc is displayed in blac*, and in 
the part corresponding to the green indicator of the SPE-ANA 
picture Pspc, only the green component of the selected picture 
Psel is displayed, and in the part corresponding to the red 
indicator of the SPE-ANA picture Pspc, only the red component of 
the selected picture Psel is displayed. 
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Fig 3D shows the composition of pictures using inverted », 
and , composed picture Pcomp is produced by perforin, the logic! 
.multiplication for each corresponding bit, in each corresponding 
pict ure element of the inverted selected picture Psel and the SPE- 
^ picture Pspc. That is, Pig. 100 shows a composed picture Pcomp 
^ inverted A»D, and the part corresponding to the background 
section of the SPE-AHA picture Pspc is displayed in blac*, and „ 
the part corresponding to the green indicator of the SPE-AKA 
picture Pspc, only the green component of the inverted selected 
picture Psel is displayed, and in the part corresponding to the 

r i-h. SPE -ANA picture Pspc, only the red component 
red indicator of the SPE ana P"-' 

of the inverted selected picture Psel is displayed. 

X„ such a composition of pictures by logical operations, the 
3mount of calculations is less than that of the alpha-blending or 
^.e iite that is generally used as a picture composing method, 
th. Picture composition can be processed at a high speed. 

selected picture Psel or the composing method is switched at a 
high speed, it is possible to produce a selected picture Psel 

following the change in rhythm. 

A t step SP9 , the CPU 50 as the composed picture display means 

copses the selected picture Psel and the SPE -ANA picture Pspc to 

pr oduce a composed picture Pcomp, and it moves to the next step 

SP10. 
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At step SP10, the CPU 50 as the composed picture display means 
displays the produced composed picture Pcomp on the liquid crystal 
display 21 for a specified time, and after that, it returns to 
step SP2. 

Thus, the CPU 50 switches the selected picture Psel by using 
the low-pitched sound of a drum, a bass or the like in the music 
data during the reproduction as a trigger, and in the meantime, it 
switches the picture composing method by using the vocal or the 
like as a trigger, and it displays the composed picture Pcomp. 

(3) Operation and Effect in Embodiments 

in the above described configuration, the CPU 50 of the note- 
PC 1 executes a spectrum analyzer program, and it frequency- 
analyzes the music data during the reproduction for each specified 
band and produces a SPE-ANA picture Pspc. 

Then, the CPU 50 selects one among a plurality of registered 
pictures Preg as a selected picture Psel, and composes the above 
described selected picture Psel and SPE-ANA picture Pspc by using 
the logical operation, and it displays that on the liquid crystal 
display 21 as a composed picture Pcomp. 

At this moment, the CPU 50 switches the selected picture Psel 
on the basis of the change of the area of the low-pitched sound in 
the music data, and in the meantime, it switches the picture 
composing method on the basis of the change of the area of the 
medium-and-high-pitched sound in the music data. 
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According to the above described configuration, by switching 
the selected picture Psel and the picture composing method on the 
fcasis of the change of the music data, it is possible to display a 
closed Picture Pcomp that changes irregular!* according to the 
change of the music data, and in the meantime, by composing the 
selected picture Psel and the SPE-AHA picture Pspc by using the 
logical operation whose composition processing time is short, .t 
is possible to change the selected picture Psel without being late 
for the change of the music data. 

(4) other Embodiments 

Herein, in the above described embodiment, the selected 
picture Psel and the picture composing method have been switched 

present invention is not limited to this, and it is also possible 
to switch the selected picture Psel and the picture composing 
method on the basis of the music by various sound sources such as 
the music inputted from the microphone 24 or the music of a music 
CD reproduced by the CD— ROM drive connected to the note-PC 1. 

Purthermore, in the above described embodiment, the selected 
picture Psel and the picture composing method have been switched 
on the basis of the music data, but the present invention is not 
limited to this, and it is also possible to switch the selected 
picture Psel and the picture composing method on the basis of 
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^ious sounds, for example, a natural sound such as the sound of 

the wave or a human voice. 

Furthermore, in the above described embodiment, the closed 

picture Pcomp has been produced by composing 

picture Pre, that is a static picture and the SPE-A- picture Pspc, 
but the present invention is not lilt- to this, and it is also 
possible to produce the ceased picture Pcc^p by composing, for 
example, a dynamic picture and the SPE-** picture Pspc. 

Furthermore, in the above described embodiment, the selected 
picture Psel has been switched by using the low-pitched sound in 
the music data during the reproduction as a trigger, but the 
present invention is not limited to this, and it is also possible 
to switch the selected picture Psel by using various changes of 

■ „,.,»«, triaer, for example, by using the medium- 

the music data as a triger, 

pitched sound as a trigger, furthermore, it is also possible to 

gl ve a visua! special effect such as wiping or defusing when 

switching the selected picture Psel. 

Furthermore, in the above described embodiment, a case has 

been described, where the CPU 50 produces and displays the 
composed picture Pcomp on the basis of the spectrum analyzer 
program previously stored in the hard disc of the HOC 67, but the 
pre sent invention is not limited to this, and it is also possible 
to perform the display of the above described composed picture 
Pcomp by installing a program storing medium in which a spectrum 
analyzer program is recorded. 
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Thus, as a program storing medium that is used for making a 
state where a spectrum analyzer program for executing the above 
described series of processing is installed in a note-PC 1 and is 
capable of being executed by the above described note-PC 1, the 
program storing medium can be realized not only by a package media 
such as a floppy disc, a Compact Disc Read-Only Memory (CD-ROM) , 
or a Digital Versatile Disc (DVD) but also by a semiconductor 
memory, a magnetic disk or the like in which a program is 
temporarily or permanently stored. Furthermore, as means for 
storing a program in these program storing media, it is also 
possible to utilize the cable and wireless communication media 
such as the local area network and internet, or the digital 
satellite broadcasting, and it is also possible to store the 
program in the state where various communication interfaces such 
as a router or a modem is intervening. 

Furthermore, in the above described embodiment, a case has 
been described, where the information processing device of the 
present invention is applied to a notebook-sized personal computer 
1, but the present invention is not limited to this, and it is 
also possible to apply the device to a desktop type personal 
computer . 

As mentioned above, according to the present invention, a 
composed picture that changes with the change of the sound can be 
produced and displayed by switching the selected picture on the 
basis of the change of the sound, and by simultaneously changing 
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the cousin, method of the f regency-analyzed picture and the 
selected picture on the basis of the change of the sound. 

While there has been described in connection with the 
preferred embodiments of the invention, it will be obvious to 
those skilled in the art that various changes and modifications 
may be aimed, therefore, to cover in the appended claims all such 
changes and modifications as fall within the true spirit and scope 
of the invention. 
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